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FURTHER  PROGRESS  ON  ROBUST/RESISTANT  UIDTHERS 


1 . Introduction. 

This  report  describes  work  carried  out  during  the  1975-77 
academic  years  by  H.  Braun,  M.  Schwarzschlld  and  J.  W.  Tukey  on  the 
development  of  robust  estimators  of  width.  An  earlier  technical 
report,  "An  Interim  report  of  a Monte  Carlo  study  of  robust  estimators 
of  width,"  by  David  A.  Lax,  describes  previous  work  undertaken  In 
connection  with  this  project.  The  Interested  reader  should  consult 
Andrews,  D.  F.,  Bickel,  P.  J.,  Hampel,  F.  R.,  Huber,  P.  J.,  Rogers, H.H. 
and  Tukey,  J.  M.,  1972.  Robust  Estimates  of  Location:  Survey  and 
Advances.  Princeton  University  Press,  Princeton,  N.  J.,  for  references 
and  Introductory  material,  as  well  as  the  results  of  the  early  Monte 
Carlo  Investigations. 

Essentially  a single  family  of  estimators  (together  with  a 
few  obvious  variations)  was  Investigated  for  sample  sizes  n ■ 10  and 
n • 20  , using  Monte  Carlo  methods.  The  authors  were  motivated  by 
considerations  of  conceptual  and  computational  simpi Id ty  as  well  as 
a desire  to  achieve  high  robustness  of  efficiency.  Moderate  success 
was  achieved  on  both  counts.  In  fact  triefficiencies  apparent,  as 
explained  below  (see  footnotes  to  page  4 and  Table  1),  of  89X  were 
obtained  for  sample  size  10. 

As  In  previous  work,  efficiencies  of  estimators  were  calcu- 
lated for  three  different  underlying  distributions.  At  sample  size 
20,  these  are  Gaussian  (0,  1)  Slash  (a  Gaussian  divided  by  an  Indepen- 
dent uniform  (0,  1)  variate),  and  Wild  (19  Gaussian  (0,  1)  1 Gaussian 
(0,100)).  The  Investigation  for  sample  size  10  was  begun  with  the 
first  two  being  the  same  as  before  but  the  third  being  9 Gaussian 
(0,1)  and  1 Gaussian  (0,9),  for  which  samples  used  In  the  Princeton 
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Robustness  Study  were  available.  Two  arguments  have  been  suggested 
for  possibly  preferring  this  to  our  standard  one  wild,  which  would 
here  by: 

9 from  Gau  (0*  1)  and  1 from  Gau  (0»  100) 

namely: 

a)  with  the  minimum  actual  non*zero  contamination 

of  any  sample  now  102,  the  variance  of  100  for  the  wild 
value  seems  possibly  excessive  (counter  argument:  for  our 
standard  one  wild  at  n ■ 20  * 5/6  of  the  variance  of  the 
i:.ean  comes  from  the  wild  one*  Increasing  this  to  10/11 
does  not  seem  excessive). 

b)  when  the  "wild  one"  comes  outside  of  ±5  , we 
surely  ought  to  be  able  to  recognize  which  observation 
Is  wild;  for  our  standard  one-wild  this  falls  to  happen 
about  2/3rds  of  the  time.  If  marginally  wild  values 
are  the  surest  test  (are  they?)  then  we  might  do  better 
with  a variance  of  less  than  100  (maximum  probabilities 
near  3 and  4 come  from  variances  of  9 and  16  respectively* 
(counter  argument:  the  general  experience*  in  the 
Princeton  Robustness  Study  and  Its  extensions*  Is  that 
Gau  (0*  9)  contamination  Is  much  easier  to  deal  with 

than  Gau  (0*  100). 

Furthermore.  It  turns  out  that  the  triefficiencies  Involving 

9 from  Gau  (0*  1)  and  1 from  Gau  (0*  9) 
are  greater  than  or  equal  to  those  Involving 

9 from  Gau  (0*  1)  and  1 from  Gau  (0*  100). 

Thus  the  latter  are*  In  fact*  tetraefficlencles  for 
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10  from  Gau 

9 from  Gau  (0.  1)  and  1 from  Gau  (0.  9) 

9 from  Gau  (0,  1}  and  1 from  Gau  (0,  100} 

10  from  slash 

More  specifically,  ^he  best  groups  of  estimators  have,  at  the  larger 
values  of  c . triefriclencles  equal  to  the  efficiency  at  the  wild 
corner,  (cf.  Table  VII). 


2.  Preliminaries. 

As  described  In  Lax,  David  A. (1975) , "An  interim  report  of 

a Monte  Carlo  Study  of  Robust  Estimators  of  Width", TR  193,  Series  2, 

Department  of  Statistics,  Princeton  University,  several  groups  of 

estimators  were  originally  Investigated,  the  most  successful  being 

of  the  ASYMPV  type.  In  particular  the  ones  corresponding  to  the 
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bisquare  --  ♦(u)  ■ u(1-u  ) --  were  among  the  top  performers.  On 

the  basis  of  these  results,  one  of  us  suggested  exploring  a"W-vers1on' 
of  the  estimator  Involving  some  7 free  parameters.  The  estimator 


was  of  the  form 

l|2 


^:(x-x)^  (1-V) 


where 

X « 


[E(1-V)‘>  (l-SV)**]  [-  e + Ed-V)*’  (1-5V)‘*] 

sample  or  "sample"  value 
X , If  g ■ 0 

one  step  biweight  (using  x , MAO)  , If  g 

0 . If  |u|  < f/(1+f) 
p+f)  hi  - f))^  , If  f/(1+f)  < |u|  < 1 

1 • 1 < hi 


(1) 


. S - NAD  . 


The  seven  free  parameters  are  labelled  a.  b.  c»  d*  e»  f*  g,  though 
not  all  appear  explicitly  In  formula  (1).  Here  "f  and  "g" 
determine  the  construction  of  the  normalized  residuals,  while  "a” 
”b"  , and  "d"  determine  how  they  will  be  used  In  the  weighting 
scheme;  finally  "c"  and  "e"  are  meant  to  be  responsive  to  the 
long-talledness  of  the  sample.  The  variance  of  the  logarithm  of  the 
estimator  was  the  measure  of  performance,  and  the  efficiency  was 
computed  relative  to  the  smallest  known  attainable  variance  for  the 
given  situation.* 

A rough  plan  of  the  Investigation  follows  below. 

(a)  early  runs  concerned  estimators  of  the  form 
(1)  with  c « 9 

(b)  the  form  (1)  was  simplified  by  removing  one  of 
the  factors  In  the  denominator 

(c)  by  allowing  e to  vary,  the  denominator 
occasionally  became  negative.  A modification 
was  Introduced  to  prevent  this  occurrence 

(d)  selected  families  if  estimators  (both  of  (a) 
and  (b)  forms)  were  Investigated  at  different 
combinations  of  c and  e . 

One  remark  on  notation  Is  In  order.  In  what  follows, 
estimators  will  be  Identified  by  their  parameter  combination 
(abd  • efg),  e.  g.  (411-100).  Families  of  estimators  will  be 
denoted  by  a convenient  shorthand.  For  example  (411-100,  200,  300) 

•Thus  all  dtflclencles  for  "slash"  or  "wild"  are  apparent 
efficiencies.  (The  minimum  variance  Is  known  for  the 
Gaussian  case.) 
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denotes  the  finlly  of  estimators  with  (a,b,d)  ■ (4,  1,  1)  e varying 
over  {1.2.3}  and  (f.g)  held  fixed  at  (0.0)  . The  value  of  the 
remaining  parameter,  c » Is  given  separately. 

3.  First  Monte  Carlos. 

Run  1 Investigated  estimators  based  on  (1)  at  sample  size 
20  . It  Included  the  following  parameter  combinations: 


(b.d) 


(b.d) 


2.4 

(1,1).  (4,0),  (6,0) 

9 

0.1 

0,1 

0 

1.2. 3. 4 

(1.0),  (2.0).  (2.1),  (4.0).  (6.0) 


a - 2.4 

(b.d)  • (1.1).  (4.0),  (6,0) 
c ■ 9 
e • 0 
f • 0.1 
9 ■ 1 

The  results  of  Run  1 Indicated  that  one  could  achieve 
computational  simplicity  without  the  usual  corresponding  loss  of 
efficiency  by  setting  the  ptrameters  f and  g equal  to  zero.  It 
also  suggested  that  It  would  be  fruitful  to  explore  a wider  range 
of  values  for  the  parameters  a.b.d,  and  c . Run  2 was  executed 

4 

accordingly  and  showed  some  Improvements. 

A new  approach  was  suggested  by  recognizing  that  the  denom1n< 
ator  In  (1)  was  analogous  In  form  to  the  factor  ''N(«1  N)" 

common  to  variance  estimates.  However.  It  was  not  clear  a priori 
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whether  the  factor  "i'l*  was  superfluous  In  some  sense  and  that  a 
new  estimator  of  the  form 


H-2  . g (x«x}^  n-V)^ 

C-e  + r (1-V)®  (1-5V)®] 


(2) 


might  do  better  as  one  tried  sample  sizes  different  from  20  . There 
would,  of  course,  bo  an  advantage  In  simplicity  as  well.  Estimators 
based  on  (2)  are  said  to  be  In  the  “short-form".  Estimators  using 
the  same  set  of  parameters,  but  based  on  (1),  are  said  to  be  In  the 
"long-form".  Run  3 accordingly  Investigated  the  short-form  of  many 
estimators  considered  In  the  previous  two  runs.  Run  4 and  5 Investi- 
gated the  long-  and  short-form  estimators  for  sample  size  10. 


A sample  of  the  results  obtained  In  these  five  runs  Is 
given  In  Table  I.  For  both  sample  sizes  10  and  20.  the  long-form 
estimators  are  In  general  superior  to  the  short- form  versions.  A 
few  groups  of  estimators  seem  to  stand  out.  For  example  at  !i  ■ 20 
the  long-form  estimators  (411-000.  100,  200)  and  (331-100,200.300) 
do  very  well.  Since  the  efficiencies  of  these  estimators  at  the 
three  corners  are  roughly  equal.  It  Is  apparent  that  little  Improve- 
ment can  be  obtained  by  varying  the  value  of  c . However  the 
picture  Is  quite  different  at  H ■ 10  , where  the  triefficiency 
of  the  same  estimators  Is  limited  by  the  efficiency  In  the  Gaussian 
corner.  Thus,  there  Is  some  chance  that  varying  the  value  of  c 
will  bring  some  Improvement  here.  (See  Table  IV  for  further  results 
in  this  direction).  Similar  considerations  apply  to  estimators 
that  performed  best  In  one  ettegory  or  another.  It  was  clear  that 
had  to  experiment  with  various  values  of  c and  an  eye  towards 
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perhaps  e’^nti^ally  allowing  the  value  of  c to  vary  with  sample 
size*  while  keeping  the  other  parameters  fixed. 

One  difficulty  with  using  values  of  "e"  greater  than 
one  Is  that  occasionally  the  denominator  becomes  negative.  In 
order  to  avoid  this  unpleasantness,  the  offending  factor  was 
replaced  by 

max  |l . [-e  + Z(l-V)‘’  (1-5V)‘^]| 

In  both  long  and  short  forms;  which  are  now  said  to  be  1n  modified 
form.  Runs  6 and  7 Investigated  modified  long-  and  short-form 
estimators  respectively  for  sample  size  10  with  values  of  c equal 
to  10,  12,  and  14.  Long-form  estimators  achieved  efficiencies  of 
89. 6X  (220-500)  and  short-form  estimators  achieved  efficiencies  of 
&9.25X  (220-600).  It  was  refreshing  to  see  these  top  estimators 
coming  from  the  same  family.  Also  the  choice  c > 10  pretty  well 
dominated  c ■ 12  or  14  . 

Finally,  using  information  gathered  above.  Runs  8 and  9 
were  planned  to  give  a more  complete  picture  of  what  had  been  found. 
Table  11  contains  the  triefficiencies  of  long-form  estimators  cross 
tabulated  by  parameters  e and  c for  various  combinations  of 
parameters  a and  b . It  seems  clear  that  new  Insights  would  be 
needed  to  bring  the  triefficiencies  of  these  estimators  above  90X. 
Table  III  presents  the  same  Information  for  short-form  estimators. 
Rui  8 also  Investigated  the  performance  of  tv/o  groups  of  estimators 
(331-efg  and  411-efg)  which  had  done  best  for  N ■ 20  , but  had  only 
had  triefffcisncles  of  79X  for  M ■ 10  . By  trying  c ■ 11  , 


triefficiency  was  raised  to  above  88X  (411-200  (c  ■ 11))  which. 
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of  course,  Is  close  to  the  best  obtained.  These  results  were 
encouraging  because  they  pointed  to  the  possibility  that  a single 
family  of  estimators  using  a value  of  c chosen  to 
depend  on  sample  size  only  would  attain  uniformly  high  trl- 
efflclencles.  Run  9 further  pursued  the  performance  of  certain 
long-form  estimators  at  11  ■ 20  ] wt  producsd  no  new  stars. 

To  complete  this  phase  of  the  work  Runs  10  and  11  Investi- 
gated the  three  most  promising  families  of  estimators  211-(short 
form),  220(long-form) , and  411-(1ong-form)  for  different  combinations 
of  c and  e , at  sample  sizes  20  and  10.  The  results  are  dis- 
played In  Tables  V and  VI. 

One  point  to  note  Is  that  the  value  of  e denoted  by 
an  asterisk  Is  an  adaptively  chosen  quantity  equal  to 

N/E(i-v)‘*(l-5v)‘*  > 1 . 

As  is  readily  seen,  this  choice  of  e behaved  very  much  like 
e ■ 1 . Furthermore,  It  1s  evident  that  while  c ■ 9 Is  the  best 
choice  when  n ■ 20  , c ■ 11  Is  the  best  choice  when  n ■ 10  . 

Hhat  Is  somewhat  surprising  1$  that  the  above  statement  holds 
simultaneously  for  all  three  families.  We  are  led  to  conclude  then 
that  we  can,  with  a single  estimator,  obtain  triefficiencies 
between  85S  and  90X  for  sample  sizes  n ■ 10  and  n « 20  , requli^ 
Ing  only  a choice  of  c dependent  on  sample  size.  Further  study 
would  undoubtedly  disclose  how  c should.  In  general,  be  chosen. 
Clearly  sample  sizes  such  as  5,  7,  40  must  be  Investigated  to 
accomplish  the  above  objective. 

Lastly,  the  three  families  of  estimators  discussed  In  the 
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previous  paragraph,  were  tried  out  on  samples  of  size  10  from  the 
wild  distribution  (cf.  discussion  In  Section  1).  At  c > 9 , the 
triefficiencies  were,  as  before,  limited  by  the  efficiency  at  the 
Gaussian  corner.  At  the  larger  values  of  c , they  tended  to  be 
limited  by  the  efficiency  at  the  wild  corner.  The  results  are 
displayed  In  Table  VII  and  should  be  compared  with  those  In 
Table  VI. 

4.  Summary. 

The  previous  section  detailed  the  rather  high  trlefficlen- 
cles  (over  35%)  achieved  by  estimators  that  are  fairly  easy  tc 
understand  and  computationally  simple.  Particular  profit  was 
realized  by  allowing  the  value  of  c to  vary  with  sample  size. 

But  the  optimal  relationship  between  them  can  not  be  known  until 
more  sample  sizes  have  been  Investigated.  For  the  moment,  we 
may  use  c * 7+  40/n  as  a rough  guide.  The  Importance  of  the 
parameter  c Is  not  unexpected  as  It  determines  the  scaling  of 
the  normalized  residuals  and  hence  how  vigorous  the  down-weighting. 

Overall,  the  estimators  of  choice  would  seem  to  be 
411-100,  300,  *00  with  c ■ 9 or  c ■ 11  (according  to  sample 
size).  They  seem  to  be  about  the  best  as  well  as  the  most  stable 
In  performance. 

dramatic  Improvements  will  be  hard  to  come  by  and  fresh 
Insights  will  be  required.  One  approach  that  Is  being  currently 
Investigated  Is  to  tailor  the  estimator  to  the  sample,  I.e.  using 
a more  adaptive  method.  The  problem  here  Is  to  seize  the  appropri- 
ate sample  characteristics  on  which  to  base  the  adaptive  nature 
of  the  estimator. 


TABLE  I 

} 

Triefftclencles  of  certain  estimators 


Estimator  j 
-ahd-e  fff  c .1 

N - 
IShort  . 

10 

Lono  1 

I ^ • 

1 Short 

20 

Lona  I 

211-0  00  9 

78.35 

79.69 

76.35 

211-1 

79.79 

81 .08 

80.01 

75.77 

211-2 

r8Tl4l] 

79.07 

80.34 

211-3 

182.60* 

75.21 

80.66 

311-0 

71.01 

80.26 

80.22 

311-1 

73.03 

81  .03 

80.82 

311-2 

75.65 

81 .60 

181.48' 

311-3 

78.87 

411-0 

76.59 

65.8 

411-1 

78.05 

86.2 

411-2 

79.70 

240-1 

74.62 

80.67 

78.89 

83.67 

240-2 

75.88 

81.64 

79.29 

240-3 

77.58 

79.73 

260-1 

74.93 

80.35 

79.55 

84.06 

260-2 

76.22 

81.15 

79.99 

260-3 

77.96 

!l2ZD 

80.47 

331-0 

67.09 

74.04 

78.18 

85.43 

331-1 

68.43 

74.79 

78.92 

85.66 

331-2 

70.20 

75.64 

79.74 

85.88 

331-3 

72.54 

75.44 

80.66 

!.<»•  .Jli: 

^ Apparent.  Since  this  report  was  prepared. 

the  best  variance 

at  the  slash 

corner  has  been  reduced  by  2. 

5%.  This  will 

temporarily 

reduce  triefficiencies  by  the 

same  amount. 

(Long 

run  reductions  of  perhaps  1.1%  can  perhaps  be  compensated  for 
by  other  Improvements  not  reported  here. 

For  this  table,  100%  efficiency  corresponds  to  variances  of 
0.0610420  (Gauss),  0.0932260  (wild),  0.204067  (slash),  for  N « 1 
and  0.0262696  (Gauss),  0.0294203  (wild),  0.0992588  (slash), 

.‘'or  N ■ 20. 


TABLE  11 


N - 10 


Triefficiencies 

of  certain 

estimators 

(modi  fled , 

long-form) 

Estimator 

abd  - e c 

9 

10 

11 

12 

220  - 0 

78.41 

83.67 

88.01 

1 

79.16 

84.28 

88.50 

2 

80.12 

85.07 

89.11 

3 

81.41 

86.10 

86.87 

4 

83.23 

87.55 

^•29j 

86.50 

5 

85‘.  96 

IsTTril 

88.39 

85.61 

6 

189.38"  > 

189.02! 

8S.36 

33.71 

240  - 0 

79.9 

85.22 

87.54 

1 

80.67 

85.84 

87.34 

2 

31.64 

86.61 

87.03 

3 

82.89 

86.54 

4 

84.55 

88.35 

85.63 

82.88 

5 

86.65 

86.42 

83.71 

81.01 

6 

34.03 

01.87 

79.49 

77.17 

250  - 0 

79.90 

85.29 

86.82 

84.17 

1 

80.62 

85.86 

86.57 

83;  88 

2 

81.51 

86.55 

86.18 

83.47 

3 

32.63 

87.38 

G5.56 

82.82 

4 

34.01 

87.15 

84.46 

81.71 

5 

35.38 

84.77 

82.14 

79.51 

6 

82. OS 

79.70 

77.28 

74.99 

^Apparent.  (Sea  footnote  to  Table  I) 


I 

r 

I 
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TABLE  III 
N - 10 

Trlefflclencles^of  certain  estimators  (modified,  short-form) 


Estimator  \c 
(abd  - e) 

9 

10 

12 

14 

220  - 3 

81.41 

87.36 

83.93 

4 

83.08 

87.41 

83.79 

5 

85.60 

87.20 

83.36 

6 

86.30 

82.24 

240  - 4 

85.17 

85.17 

81.55 

5 

l^aJUL' 

84.04 

80.29 

6 

85.94 

81.11 

77.66 

250  - 3 

83.51 

85.03 

00 

• 

in 

4 

85.48 

84.42 

80.79 

5 

I98JJL! 

82.97 

79.21 

6 

84.08 

79.25 

75.28 

^Apparent.  (See  footnote  to  Table  I) 


1 


TABLE  IV 

1 N • 10 

Triefficiencies  of  certain  estimators  (modified,  long-form) 


Estimator  - c 

10 

11 

(abd  - e) 

331  - 1 

80.73 

85.55 

2 

81.40 

86.05 

3 

81.98 

85.81 

4 

81.87 

83.46 

5 

78.63 

73.72 

6 

71 .95 

75.48 

411  - 1 

83.04 

87.22 

2 

84.55 

88.56 

3 

85.98 

86.59 

4 

83.76 

82.84 

5 

78.80 

78.04 

6 

78.55 

76.19 

Apparent. (See  footnote 


to  Table  I) 


TABLE  V 


Trlefflciencles^  of  certain  estimators 

(N  - 20) 


c ■ 

7 

8 

9 

11 

(short) 

1 

76.30 

82.59 

80.01 

71 .03 

* 

76.68 

82.72 

80.07 

71.05 

3 

78.60 

83.69 

80.66 

71.26 

6 

80.28 

79.55 

77.82 

71.51 

(long) 

1 

73.64 

81.56 

82.33 

74.78 

* 

73.81 

81 .69 

82.38 

74.81 

3 

74.75 

82.41 

82.92 

75.18 

6 

77.09 

84.16 

84.12 

76.01 

(long) 

1 

75.63 

82.55 

86.20 

82.93 

* 

75.93 

82.82 

86.27 

82.97 

3 

77.38 

84.13 

86.59 

83.32 

6 

77.53 

82.95 

82.31 

80.28 

^Apparent.  (See  footnote  to  Table  I) 


TABLE  VI 


Trlefficlendes^ of  certain  estimators 
(N  » 10) 


c ■ 

11 

12 

13 

211  (short) 

1 

79.79 

84.01 

81.82 

80.45 

* 

79.95 

83.57 

81.45 

80.09 

3 

82.66 

80.77 

78.81 

77.53 

6 

73.24 

70. P2 

68.36 

66.93 

220  (long) 

1 

79.16 

84.28 

88.50 

87.15 

85.23 

* 

79.25 

88.55 

87.12 

85.18 

3 

81 .41 

86.10 

89.62 

86.87 

84.86 

6 

89.38 

89.02 

86.36 

83.71 

81 .63 

411  (long) 

1 

78.05 

83.04 

87.22 

83.58 

87.30 

* 

78.21 

(83±) 

87.35 

88.22 

36.94 

3 

81.05 

35.98 

86.59 

85.54 

84.33 

6 

73.26 

78.55 

76.19 

74.46 

73.20 

Apparent.  (See  footnote  to 

Table  I) 

TABLE  VII 

Triefficienclef ^of  certain  astlmators 
(N  • 10) 


c ■ 9 

11 

12 

13 

(short) 

1 

79.55 

71.20 

66.19 

61.59 

* 

79.76 

71.26 

66.21  : 

61.60 

3 

80.88 

71.43 

66.22 

61.50 

6 

71.14 

64.43 

60.58 

56.81 

(long) 

1 

79.16 

(85.85) 

77.95C88.50] 

72.75 

67.77 

* 

79.25 

(86.10) 

78.12C88.55] 

72.84 

67.84 

3 

81.41 

(88.25) 

79.57C89.91] 

74.11 

68.92 

6 

89.38 

(96.79) 

85.35C94.58] 

78.99 

73.07 

(long) 

1 

78.05 

(88.40) 

85.64C87.22] 

82.41 

78.79 

* 

78.21 

(88.73)  8S.79C87.35] 

82.47 

78.83 

3 

81.05 

(90.75) 

86.59C89.88]  83.03 

79.23 

6 

73.26 

(79.99) 

76.19(78.89) 

74.46  (76.81) 

73.20 

fra  the  distributions  being 

the  one«w11d  (with  1 6au  (0.100)).  Numbers  In  ( ) are 

efficiencies  at  the  one-wild  corner  when  It  differs  from 
the  triefficiency.  Numbers  In  [ 1 are  efficiencies  at  the 
fiausslan  (which  determines  the  triefficiency  here  for  c ■ 9). 

afficlency  for  the  one-wild  used  here 
SJhIIK  .0888569.  (The  100*  efficiency 

tables*)  corners  are  the  same  as  In  the  previous 


